Pedestrian Trajectory Prediction with Structured Memory Hierarchies

This paper presents a novel framework for human trajectory prediction based on multimodal data (video and radar). Motivated by recent neuroscience discoveries, we propose incorporating a structured memory component in the human trajectory prediction pipeline to capture historical information to improve performance. We introduce structured LSTM cells for modelling the memory content hierarchically, preserving the spatiotemporal structure of the information and enabling us to capture both short-term and long-term context. We demonstrate how this architecture can be extended to integrate salient information from multiple modalities to automatically store and retrieve important information for decision making without any supervision. We evaluate the effectiveness of the proposed models on a novel multimodal dataset that we introduce, consisting of 40,000 pedestrian trajectories, acquired jointly from a radar system and a CCTV camera system installed in a public place. The performance is also evaluated on the publicly available New York Grand Central pedestrian database. In both settings, the proposed models demonstrate their capability to better anticipate future pedestrian motion compared to existing state of the art.Comment: To appear in ECML-PKDD 201

Grid Cells Encode Local Positional Information

The brain has an extraordinary ability to create an internal spatial map of the external world [1]. This map-like representation of environmental surroundings is encoded through specific types of neurons, located within the hippocampus and entorhinal cortex, which exhibit spatially tuned firing patterns [2, 3]. In addition to encoding space, these neurons are believed to be related to contextual information and memory [4-7]. One class of such cells is the grid cells, which are located within the entorhinal cortex, presubiculum, and parasubiculum [3, 8]. Grid cell firing forms a hexagonal array of firing fields, a pattern that is largely thought to reflect the operation of intrinsic self-motion-related computations [9-12]. If this is the case, then fields should be relatively uniform in size, number of spikes, and peak firing rate. However, it has been suggested that this is not in fact the case [3, 13]. The possibility exists that local spatial information also influences grid cells, which-if true-would greatly change the way in which grid cells are thought to contribute to place coding. Accordingly, we asked how discriminable the individual fields of a given grid cell are by looking at the distribution of field firing rates and reproducibility of this distribution across trials. Grid fields were less uniform in intensity than expected, and the pattern of strong and weak fields was spatially stable and recurred across trials. The distribution remained unchanged even after arena rescaling, but not after remapping. This suggests that additional local information is being overlaid onto the global hexagonal pattern of grid cells

A flexible component-based robot control architecture for hormonal modulation of behaviour and affect

This document is the Accepted Manuscritpt of a paper published in Proceedings of 18th Annual Conference, TAROS 2017, Guildford, UK, July 19–21, 2017. Under embargo. Embargo end date: 20 July 2018. The final publication is available at Springer via https://link.springer.com/chapter/10.1007%2F978-3-319-64107-2_36. © 2017 Springer, Cham.In this paper we present the foundations of an architecture that will support the wider context of our work, which is to explore the link between affect, perception and behaviour from an embodied perspective and assess their relevance to Human Robot Interaction (HRI). Our approach builds upon existing affect-based architectures by combining artificial hormones with discrete abstract components that are designed with the explicit consideration of influencing, and being receptive to, the wider affective state of the robot

Electrophysiological characterization of texture information slip-resistance dependent in the rat vibrissal nerve

<p>Abstract</p> <p>Background</p> <p>Studies in tactile discrimination agree that rats are able to learn a rough-smooth discrimination task by actively touching (whisking) objects with their vibrissae. In particular, we focus on recent evidence of how neurons at different levels of the sensory pathway carry information about tactile stimuli. Here, we analyzed the multifiber afferent discharge of one vibrissal nerve during active whisking. Vibrissae movements were induced by electrical stimulation of motor branches of the facial nerve. We used sandpapers of different grain size as roughness discrimination surfaces and we also consider the change of vibrissal slip-resistance as a way to improve tactile information acquisition. The amplitude of afferent activity was analyzed according to its Root Mean Square value (RMS). The comparisons among experimental situation were quantified by using the information theory.</p> <p>Results</p> <p>We found that the change of the vibrissal slip-resistance is a way to improve the roughness discrimination of surfaces. As roughness increased, the RMS values also increased in almost all cases. In addition, we observed a better discrimination performance in the retraction phase (maximum amount of information).</p> <p>Conclusions</p> <p>The evidence of amplitude changes due to roughness surfaces and slip-resistance levels allows to speculate that texture information is slip-resistance dependent at peripheral level.</p

Prolonged dopamine signalling in striatum signals proximity and value of distant rewards

Predictions about future rewarding events have a powerful influence on behaviour. The phasic spike activity of dopamine-containing neurons, and corresponding dopamine transients in the striatum, are thought to underlie these predictions, encoding positive and negative reward prediction errors. However, many behaviours are directed towards distant goals, for which transient signals may fail to provide sustained drive. Here we report an extended mode of reward-predictive dopamine signalling in the striatum that emerged as rats moved towards distant goals. These dopamine signals, which were detected with fast-scan cyclic voltammetry (FSCV), gradually increased or—in rare instances—decreased as the animals navigated mazes to reach remote rewards, rather than having phasic or steady tonic profiles. These dopamine increases (ramps) scaled flexibly with both the distance and size of the rewards. During learning, these dopamine signals showed spatial preferences for goals in different locations and readily changed in magnitude to reflect changing values of the distant rewards. Such prolonged dopamine signalling could provide sustained motivational drive, a control mechanism that may be important for normal behaviour and that can be impaired in a range of neurologic and neuropsychiatric disorders.National Institutes of Health (U.S.) (Grant R01 MH060379)National Parkinson Foundation (U.S.)Cure Huntington’s Disease Initiative, Inc. (Grant A-5552)Stanley H. and Sheila G. Sydney Fun

Theta-paced flickering between place-cell maps in the hippocampus

The ability to recall discrete memories is thought to depend on the formation of attractor states in recurrent neural networks. In such networks, representations can be reactivated reliably from subsets of the cues that were present when the memory was encoded, at the same time as interference from competing representations is minimized. Theoretical studies have pointed to the recurrent CA3 system of the hippocampus as a possible attractor network. Consistent with predictions from these studies, experiments have shown that place representations in CA3 and downstream CA1 tolerate small changes in the configuration of the environment but switch to uncorrelated representations when dissimilarities become larger. The kinetics supporting such network transitions, at the subsecond time scale, is poorly understood, however. Here we show that instantaneous transformation of the spatial context (\u2018teleportation\u2019) does not change the hippocampal representation all at once but is followed by temporary bistability in the discharge activity of CA3 ensembles. Rather than sliding through a continuum of intermediate activity states, the CA3 network undergoes a short period of competitive flickering between pre-formed representations for past and present environment, before settling on the latter. Network flickers are extremely fast, often with complete replacement of the active ensemble from one theta cycle to the next. Within individual cycles, segregation is stronger towards the end, when firing starts to decline, pointing to the theta cycle as a temporal unit for expression of attractor states in the hippocampus. Repetition of pattern-completion processes across successive theta cycles may facilitate error correction and enhance discriminative power in the presence of weak and ambiguous input cues

Order-Based Representation in Random Networks of Cortical Neurons

The wide range of time scales involved in neural excitability and synaptic transmission might lead to ongoing change in the temporal structure of responses to recurring stimulus presentations on a trial-to-trial basis. This is probably the most severe biophysical constraint on putative time-based primitives of stimulus representation in neuronal networks. Here we show that in spontaneously developing large-scale random networks of cortical neurons in vitro the order in which neurons are recruited following each stimulus is a naturally emerging representation primitive that is invariant to significant temporal changes in spike times. With a relatively small number of randomly sampled neurons, the information about stimulus position is fully retrievable from the recruitment order. The effective connectivity that makes order-based representation invariant to time warping is characterized by the existence of stations through which activity is required to pass in order to propagate further into the network. This study uncovers a simple invariant in a noisy biological network in vitro; its applicability under in vivo constraints remains to be seen

Distributed Dynamical Computation in Neural Circuits with Propagating Coherent Activity Patterns

Activity in neural circuits is spatiotemporally organized. Its spatial organization consists of multiple, localized coherent patterns, or patchy clusters. These patterns propagate across the circuits over time. This type of collective behavior has ubiquitously been observed, both in spontaneous activity and evoked responses; its function, however, has remained unclear. We construct a spatially extended, spiking neural circuit that generates emergent spatiotemporal activity patterns, thereby capturing some of the complexities of the patterns observed empirically. We elucidate what kind of fundamental function these patterns can serve by showing how they process information. As self-sustained objects, localized coherent patterns can signal information by propagating across the neural circuit. Computational operations occur when these emergent patterns interact, or collide with each other. The ongoing behaviors of these patterns naturally embody both distributed, parallel computation and cascaded logical operations. Such distributed computations enable the system to work in an inherently flexible and efficient way. Our work leads us to propose that propagating coherent activity patterns are the underlying primitives with which neural circuits carry out distributed dynamical computation

Selective Reduction of AMPA Currents onto Hippocampal Interneurons Impairs Network Oscillatory Activity

Reduction of excitatory currents onto GABAergic interneurons in the forebrain results in impaired spatial working memory and altered oscillatory network patterns in the hippocampus. Whether this phenotype is caused by an alteration in hippocampal interneurons is not known because most studies employed genetic manipulations affecting several brain regions. Here we performed viral injections in genetically modified mice to ablate the GluA4 subunit of the AMPA receptor in the hippocampus (GluA4HC−/− mice), thereby selectively reducing AMPA receptor-mediated currents onto a subgroup of hippocampal interneurons expressing GluA4. This regionally selective manipulation led to a strong spatial working memory deficit while leaving reference memory unaffected. Ripples (125–250 Hz) in the CA1 region of GluA4HC−/− mice had larger amplitude, slower frequency and reduced rate of occurrence. These changes were associated with an increased firing rate of pyramidal cells during ripples. The spatial selectivity of hippocampal pyramidal cells was comparable to that of controls in many respects when assessed during open field exploration and zigzag maze running. However, GluA4 ablation caused altered modulation of firing rate by theta oscillations in both interneurons and pyramidal cells. Moreover, the correlation between the theta firing phase of pyramidal cells and position was weaker in GluA4HC−/− mice. These results establish the involvement of AMPA receptor-mediated currents onto hippocampal interneurons for ripples and theta oscillations, and highlight potential cellular and network alterations that could account for the altered working memory performance

Neural Computation via Neural Geometry: A Place Code for Inter-whisker Timing in the Barrel Cortex?

The place theory proposed by Jeffress (1948) is still the dominant model of how the brain represents the movement of sensory stimuli between sensory receptors. According to the place theory, delays in signalling between neurons, dependent on the distances between them, compensate for time differences in the stimulation of sensory receptors. Hence the location of neurons, activated by the coincident arrival of multiple signals, reports the stimulus movement velocity. Despite its generality, most evidence for the place theory has been provided by studies of the auditory system of auditory specialists like the barn owl, but in the study of mammalian auditory systems the evidence is inconclusive. We ask to what extent the somatosensory systems of tactile specialists like rats and mice use distance dependent delays between neurons to compute the motion of tactile stimuli between the facial whiskers (or ‘vibrissae’). We present a model in which synaptic inputs evoked by whisker deflections arrive at neurons in layer 2/3 (L2/3) somatosensory ‘barrel’ cortex at different times. The timing of synaptic inputs to each neuron depends on its location relative to sources of input in layer 4 (L4) that represent stimulation of each whisker. Constrained by the geometry and timing of projections from L4 to L2/3, the model can account for a range of experimentally measured responses to two-whisker stimuli. Consistent with that data, responses of model neurons located between the barrels to paired stimulation of two whiskers are greater than the sum of the responses to either whisker input alone. The model predicts that for neurons located closer to either barrel these supralinear responses are tuned for longer inter-whisker stimulation intervals, yielding a topographic map for the inter-whisker deflection interval across the surface of L2/3. This map constitutes a neural place code for the relative timing of sensory stimuli